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Given the fundamental program changes that have 
occurred in the nation's social programs since President Reagan took 
office, federal evaluation activities need to be rethought and 
redirected. It is critical that the utility of programs be « 
documented, economical delivery services be developed, and redundancy 
of interventions be reduced to optimize the return from public \ A 
expenditures. It is urgent tha^j^ revised federal evaluation agenda 
be formulated which could bev influential in determining future social 
program policies. During the past decade the strong evaluation 
capacities developed in domestic social programs were coupled with 
increasing dissemination and utilization of evaluation results which* 
are now relevant to current White House commitments. In setting 
evaluation-objectives and priorities for the 1980's, five activities 
require both short- and long-term^ investments: (1) estimation of the* 
net impact, in terms of cost saudngs and consequences for 
populations, of implemented and^rojected cutbacks in social , 
programs; (2) implementation of social experiments to provide 
services at reduced costs by increasing competition, consumer options 
and volunteerism; (3) examination of the objectives andpriorities 
among current social programs; (4) assessment of established programs 
in comparison with alternative interventions; and (5) development of 
accountability procedures to maximize block grant program impacts. 
(CM) <. 
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1 « " . v ' PROLOGUE 



Since taking office^ President Reagan and 'his administration have 
proposed, and to a large extent successfully initiated, remarkable mod- 
ifications in the nation 1 s* social programs. The impact will be profound 
in all sectors, and* for all persons, groups, and.social, institutions. 
Across the board, reduced-funding will require xutbacks./in services* 
substitution of/less costly interventions, or. restrictions in eligibil- 
ity. For those programs to be administered under, the new block grants r 
to states, delivery systems and accountability procedures will^be rad- 
ically modified,- and heterog'eneity in program activities markedly in- 1 

creased. ' , ° " 

Given the fundamental pcogfam* changes that have occurred,' federal, 
evaluation activities need to be rethought and redirected. Pre-Reagan 
evaluation activities emerged from three decades Of expandingMresource 
commitments and efforts to achieve social goals-no longer as salient as 
in, the past.- The new national commitments require setting hew goals and 
priorities for evaluation activities in order to maximize evaluation's 
utilfty for shaping and implementing domestic^ social programs. Given 
the thrust of the Reagan 'administration, it is critical to document the 
utility of programs, develop economical ways of delivering services*, and 
reduce overlap and redundancy of interventions so as to optimize the re- 
turn from public expenditures supporting these programs and services. In 
order to do so, I believe it is urgent to formulate a revised federal eval 
uation agenda applicable and relevant to the range o*f 'domestic social 
programs. °? . 

/ - 1 : • ■ 
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• This paper is. apolitical in the sense that I stall avoid challeng- 
ing the current direction of federal social program activities.* For 
those of us whose evaluation careers span the. O.E.O. and Great Society 
eras, and whose outlooks were influenced by efforts at centrally-directed 
social planning, the new scheme .of things is- difficult to fully grasp 
and to identify with. So be it. In large measure, Reagan's' thrust has ' 
both political and popular support. A fair test of the administration's 
approach to dealing with the human Condition requires responsible partici- 
pation by the evaluation community." In my opinion, sideline p*otagonism 
is neither productive nor likely to shift the direction of policies. 
Sojund evaluation' efforts, however, could be influential in determining 
the administration's future sociaf program policies. 

A BRIEF SKETCH OF FEDERALLY-SUPPORTED EVALUATION ACTIVITIES 

In the past decade, the Executive Departments sponsoring and admin- 
istering domestic social programs have developed strong evaluation capaci- 
ties. Internal department staffs'' increased commitment to t and sophisti- 
cation about evaluation activities, growth in the number of competent 
contractors, improved contracting and monitoring procedures, and critical 
examinations of previous work (Bernstein & Freeman, 1975) have contributed 
to the present evaluation strength of the major operating agencies and , 
the Offices of the Secretaries in the Departments of Health and Human 
Services-, Education; Housjng and Urban Development; Labor; Justice; f En- 
*ergy; and Agriculture. The boundaries of the evaluation field remain 
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elusive and the fod of different government groups vary; but the^se groups 
generally have capacities to either internally undertake or 'externally con- 
tract for assessments to identify problem areas and estimate program needs, 
to mount formative studies to develop and refine programs, to monitor pro- 
cedures to determine program accountability, and to conduct impact, anal- 
yses to measure the effectiveness and efficiency of both innovative and 
established social programs. ^ "* 4 ^ 

- Further, there Jias been serious efforts within these departments 
and sjioh groups as the General Recounting. Off ice and the Office of Manage- 
ment and Budget to facilitate the dissemination and utilization of eval- 
uation results. Both the immediate and direct utilization of individual 
studies, as well .as the cumulative, conceptual * use of sets of evaluations, 
have been increasingly evident in recent years in* the policy and adminis- 
a^rative decisions of Executive Departments., "in Congressional del iterations i 
•and in- the activities of citizen advocacy groups. - 

Many recently completed and on-going evaluations are relevant to 
current White House commitments, and the current and projected changes 
and reductions in social programs. For example, in the health care field, 
demonstration-evaluation -efforts to reduce hospitalj-zaThDn' for the chron- 
•ically and terminally ill through community-based "case management" pro- 
grams and hospices' are directly relevant to'cost-containme'nt of medicaid^ 
^ and medicare expenditures. Other examples, such as efaluationpof nutrition 
programs for preschool and school children and support of efforts to develop 

management information systems also have utility for program accountability,. 

.• . S 
N particularly in terms of the new block-grant initiatives. > 

N ■ • 
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Thus, there is both a capacity to undertake evaluation studies and 
a body of completed and on-going efforts that can provide a strong start 
in setting evaluation objectives and priorities fpr the 1980's. At the ■ 
same time, the radically revised federal approach to social programs does 
require redirection of efforts. • h propose in this paper to focus on five 
activities that require both short and long term investments: 

1. Estimation of the net impact, in terms of cost savings and 
consequences for target populations, of, the implemented 
and projected cutbacks in social programs*. 

2. Implementation of social experiments to provide services at>v 
reduced costs by increasing (1) competition among providers , - 
(2) .consumer options,, and -(3) vol unteerism. .. , 

' 3". Examination of the appropriateness of thfc objectives of cur- 
rent social programs and the priorities among them.; i 

4. Assessment of the effectiveness and efficiency of establ ished 
programs in comparison with alternative ilnterv&ntiOTTs designed 
to meet' defects in the social and human condition. 

5. Development of procedures to insure accountability and to maxi- 
mize impact of programs placed under block, grants to states. 

V • ' - : . : : ■ 

MEASURING THE NET IMPACT OF SOCIAL PROGRAM "COST CONTAINMENT 

A clear decision has been made" to reduce the federal expenditures, 
for social programs, although th,e level of these reductions and their 

or 

extent in different areas may. fluctuate. The str^a^pgy. underlying these 
reductions is one of redefining eligible target populations and reducing 
the sefvices provided to .the remaining targets: Elimination of over 
one-million persons from the food stamp program is an example of popula- 
tion redefinition; reduction of federal contributions to locally-adminis- 
tered social .service programs is an example of service' reduction.- In 



both cases, it is important to estimate net-impacts in terms of dollar 

savings and in terms of consequences for the target populations involved. 

* • I 

There are two general points to be made. First, a Wategy is needed 

to generate- knowledge of short- and long-term net effects in terms of \* 
cosCimpact and the consequences for the target populations. Second, , 
developing the evaluation designs and ensuring the necessary -support for 
t^he evaluation activities in forming such assessment will require the ^ 
collaboration of different operating agencies within Executive Departments 
and, in many cases, between Departments. Such intra- and inter-departmen- 
tal collaboration will require forceful 0MB and White House leadership,' 
since the "turf" problems within and between departments* do not change 
with the election of a new president. Finally, I 'suggest that the issue 
of net impacts needs to "be given the highest priority \ fpr_p¥e-ppst - 
Reagan results will require data that become increasingly difficult to 
reconstruct with" the passage of .tiW. 

1 * ' ' 

The 'Cost- Impact Issue ' ( ^ . 

. ' The cos^issue caji be viewed conceptually as "a complex matter of 
' transfer payments.- One illustration of this issue will serve to place v 
the political stir surrounding -transfer payments in context. Changing, 
the eligibility requirements for minimal social security entitlement 
could result in a net cost. reduction much smaller than the gross re- 
dutftion since ^some affected families and individuals would then become 
ei.iTp'ble for public welfare. There are .numerous and reasonably under- 
stood subtleties regarding transfer payments,- such as impact on state 



and local expenditures, compensating program eligibility, consequences 
for income tax and other tax receipts; and so on. Clearly, as undoubtedly 
is ^eing done, careful simulation and modeling can provide useful short 
and long-range -estimates of net* cost impact... 

But I believe that there are at least three strong reasons for pri- 
mary, data collection in-order to have firm estimates of net cosN: impact:- 
" . 1. Our- knowledge of the extent to which program target populations 
will seek and' obtain* substitute progra^Benef its is inadequate. Par? (jf 
the population may\ee the available alternatives as stigmatizing and 
choose not to pursue them, 'in this case, net impact (i.e., cost reduc- 
tions) will be greater than. would be the case if all eligible transfers 
occurred. However, opting for a substitute 9r^jtua^f^^ that the 
population receives a greater number of services* than they had in the 
past, because these services are requirements of or are built into the . 4 
substitute program. Thus, net impact may be lower than anticipated. On 
the one hand^ for example, changing medicare eligibility or the scope 
of services it provides may reduce total -use Of health services and their 
"costs because some eligible^ individuals may not elect medicaid. On the 
other hand, reduction in student loans for children^of middl e-income 
families 'may increase other costs; the affected students toay enter the 
peripheral labor force, and their sporadic work opportunities may make 
them eligible to receive not only unemployment benefits, but also fcoun- 
seling and employment-appartunity assistance. 

2. The lack of uniformity and consistency in eJigibility deterniin- 
ation both for programs and specific services may result in unexpectedly 
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higher or lower net cost impacts. There are many state*, local, and 
agency- specific differences in practices 'and administrative procedures 
surrounding eligibility, as well as'variations related to target popu-.. 
lation characteristics". "We "have* no. way of estimating how much target 
"shopping" among alternative programs may occur or the costs of such • 
shopping. We cannot assess the "domino .effect" of persons, transfer- 
ring from a , curtailed program into a dif/ererjt program; these transfers 
may displace pther targets who were enrolled and they in turn seek ; * 
other options, which again may displace still other targets," and sq on. 
Also, the cost reduction consequences may be different for populations 
using one delivery system compared with another. For. example, reduction 

in. the sqope of- community mental health and mental retardation programs 

■ * . 
may haveVjittle impact on physician. visits' for persons who use fee-for- 

service provi^^s ; (TncT^jding, importantly, medicare patients) because 
the co-insurance costs inhibit increased physician visits for such ser- 
vices. Experi fences-- Organizations (HMQKJiow- 
ever, suggestXhat prwi^^^^sits (in the absence*of psychological 
services) arA]j>gtf^r i^^^ie settings, and savings may be much more mod- 
est for those who receive health services i if HMOs. « . ■> 

- 3. Net-impact costs may increase qr decrease because of agency 

"skimming" or program overrecruitment.. Human servfee age^ies faced 

8 . ' ' ' ' 

with dollar curtailments, particularly if the'y are paid oh a per unir 

basis, may 3eek ^maximize "profits" by selegting those target popula- 

tions easiest to deal with and requiring the least cost to treat, or 

by encouraging targets' use of prograjms so that the agency bas increased 



% . numbers' of. targets to maintain Vevenues. Fjor exampli,- a delinquency 

" ^ J 
^ontrot program may choose either to eliminate violent, adolescents who 

may require extensive -efforts, of to increase its population by recruitr • 
i " ' & 

- ing targets with marginal requirements? ' ■' » - 

i" Admittedly, thd£ are instances where the concerns .voiced above 

( ° • fa. ' ^ 

are minimal. In the case of programs of cash payments, where reliable- \' 

-and valid "tests" define :el igibil ity, and where the interventions are 

'• ■* . i 

technological rather than interpersonal, the kinds of risks I allude to 

am minimal. In other cases, howeyer, neither the risks nor their atten--, 
*v__d4nt costs can 'be accurately estimated. To the "extent that the processes 
I described operate, pressure for increased expenditures maty impede cost- 
containment efforts and reduce savings; '^""^ . 

I believe two directions of work are required. First, for those 
programs which are particularly vulnerable to-'the processes outlined and 
which are markedly curtailed, garget populations shpuld be sampled and 
followed longitudinally" (with retrospective information on, say, 1980-1981" 
participation) so that cost-impact can be estimated adequately and admin- 
istrative safeguards introduced if required. Second, there 'is continuing/ 
or completed work in various program areas that is directed at estimating 
target population size and characteristics and which. provides procedures 
to*screen targets for "false positives." This work should be examined 
and7 If there -is potential payoff, studies continuing this kind of irives- 
plrrgatioil should be initiated. To the extent that programs- have o^-^P^, 
^ ping «Ligibility requirements, cost-containment effects may^ be hampered . 



by targets seeking other program options in which guidelines permit 
their enrollment and thus create pressures for- additibnal funding. 

Consequences for Targets ..,, . 

The rhetoric of social program cutbacks includes expressed concern 
with the consequences of current policies for the human condition-. In 
some cases, reduction and curtailment of programs may be warranted be- 
cause of their minimal effectiveness,, and, in benefit to cost terms, be- 
cause of their^ck of efficiency. Certainly, some programs .have been 
properly .evaluated, and their lack of impact is evi dene? of their limited n 
utility, despite \h'e persuasiveness and good intentions of sponsorXand 

advocates. In general . however, there have not been sufficient, firm 

- A 

evaluations 'of established, full-coverage social programs. The difficulty ,. 
of course*, has been tfiat programs of full coverage leave no adequate 'com- 
parison populations so that participants can be compared- with non-partici- 
pants/ The same situation pertains when trying to estimate, for programs 
firmly in place, whether their comprehensiveness and intensity are required 
or whether a less comprehensive intervention would hav-e^ the same utility. 
■'Pre-post Reagan' 1 studies* represent a unique opportunity to do rigorous 
comparison group(s) experiments. Also, the block grant programs, about 
which I shall have more to say, provide similar opportunities since in- 
dividual states will be packaging programs of different content, scope, 

and intensity. ' v . 

It is also acknowledged that some of the social program curtailments 
will, result in reduced benefits and opportunities for target populations. 
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but that the administration requires these quality of, life sacrifices 
•in order to achieve national budgetary objectives. v In terms of relative 
value choices, there is no question that such curtailments represent le- 
gitimate political decisions. At the same time, unless indirect impacts 
are estimated, the benefits to costs cannot be reasonably established. 

For example, <t may be argued that if reduced federal support for 
•schools leads to curtailment or elimination of non-educaftionally related 
aspects of school programs, such reduction is a responsible choice and 
a necessary "sacrifice." But if curtailment of school heal th programs 
and after-school activities increases parental obligations in way^s that 
significantly limit full-time employment opportunities for working mothers 
in low income families, then that is another matter. There may be instances 
in contrastj where the indirect effects are positive. Reducing non-educa-^ 
tional skills aspects of- school programs ma/ result, for; example, in in- 
creased parental participation in child- related activities, with beneficial 
impacts on the quality of family life. 

From a broad perspective then, efforts to contain and reduce social 
programs can properly be looked at as "social experiments" in the same 
sense that various efforts to expand and innovate were seen in' previous 
times. From a practical and political viewpoint, knowledge of the impact 
of program cutbacks may serve the current administration in both defending 



their actions and in deciding upon whet^ future reductions are called for. 
Certainly it is not sensible to argue that all pre- 1981 programs, particu- 
larly those that mandatedVful V coverage of target populations, vwerre called 
for in terms of effectiveness and efficiency. 
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Measuring impact in terms of both costs and benefits to target popula- 
tions requires timely evaluations. In many program areas, extant inf or- ■ 
mation from pre-Reagan days is limited, or not retrievable, and unreliable 
in any event. Immediate review of which programs should be evaluated in 
terms of net impact, and the data requirements to reach firm conclusions, 
is called' for. ' • . 

' ; IMPLEMENTING AND EVALUATING NEW INITIATIVES * 
w * 

Although the cost containment'emphasis has been on budget cuts, pro- 
gram modifications and refinements have also-been suggested as an essen- 
tial part of the Reagan administration effor%. « These center around three 
related initiatives, specifically 'to increase (1) provider competition, 
'(2) available options for services, and (3) volunteerism. These initiative 
are not originaV, they were als^ advocated in previous administrations. 
Educational vouchers have been experimented w^ti in the past, as has the 
idea of "production incentives" (i.e.., profit determined by results) in 
the educational sector; and case-management. demonstrations ip the health 
• field include the use of .volunteer case managers. But it is fair to ac- 
knowledge that these concepts, in general, have neither been converted 
into 1 viable programs nor firmly assessed. Careful program development 
and evaluation needs to proceed putting national initiatives in place. 
Initiatives, one should realize from past experiences, are difficult to 
implement without adequate pitting. Moreover, once installed on a full 
"coverage basis, they can neither be revoked easily nor rigorously evaluated 
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.Part of the problem with previous efforts along these lines has been 
the actions 'of involved groups to hamper both the implementation and eval- 
uation of demonstrations. She field of education offers instructive ex- >^ 
amples, with a sharp illustration found in. the experiment to ^evaluate 
whether or not public school instruction in educational skills could be 
enhanced by programs created and implemented by industry and for which 
the companies would receive payments based on students' test performance. 
Both the implementation of the program and its evaluation, was- hindered, / 
delayed, and eventually scuttled by^ pressures from the educational estab- 
lishment, the actions of school staff, and the lack of firm commitment 
on the part of government officials (Gramlich, 1975). 

fn health and education,- voucher initiatives again are being advo- ■ 
cated and they are consistent with the present administration's philosophy 
(in the case of health primarily to reduce or control costs, and in educa- 
tion to increase parental choice and perhaps impact on the efficacy'of 
schools).. Vouchers would, in both .cases, have major consequences for > 
existing organizations and the professionals-in the respective fieWf. 
From the long term standpoint, certainly, these "radical" program innova- 
tions merit testing. To do so, however, requires careful orchestration 
and development. Neither mandating them on a national basis nor half- 
hearted demonstrations with weak evaluations is the- appropriate federal 
posture. 

If anything, the admonition that we need to move closer to being an 
experimenting society is more relevant now than in periods of greater 
"abundance and relatively unrestrained public resource expenditures for 



social programs'. A national political leadership that has. turned the ' 
fiscal policies of the nation around in such a short period of time may 
be in a position, over the next, several years to implement and evaluate! 
initiatives more effectively than ever before— and ones consistent with 
their philosophy of governmental and social arrangements. 

. Efforts to evaluate initiatives such as those espoused by the present 
administration should take lessons from previous experiences in designing 
and testjpg social innovations. First, not only must the concepts them- 
selves be tested for their utility, but the appropriate levels of program 
inputs need to be assessed.^ For example, health care^vouchers that pro-" 
vide the median medicaid benefits now paid, with eligible participants y 
purchasing supplementary health insurance at their option, Would consti- 
tute' a much different program than one that provided 110 percent" of the 
median if supplementary insurance was purchased and 80 percent of the 
median if it were not. The former case might have greater acceptance by 
the beneficiaries but have major consequences for hospital funding; the 
latter case would offer" the reverse. Similar relationsips would also hold 
if we contrast programs that stimulate statewide educational^ voucher pro-' 
grams by increased educational block grant funding with programs which -do 
not* Private enterprise, profit-incentive programs in the educational 
sector would have different impacts depending upon the rate of return, 
depending- upon whether the federal government did or did not provide 
states or school districts with incentives to initiate vouche/ programs. 

Second, evaluations require policymaker commitment to a set of out- 
come measures. For example, the original headstart evaluation resulted, 



in addition to accusations- of methodological defects, in advocates claim- 
ing that inappropriate outcome measures were employed (although this 
would have been very unlikely if there had been clear findings of positive* 

impact). -J 

f Third, I urge multiple evaluations (Croribach & Associates, 1980). 
Too often, social experiments have succeeded or fallen on the basis of_ 
single evaluations with no opportunity to take into- account how variations 
in design and the conduct oj the evaluations may have influenced the find- 
ings. I-would argue that the, cost of conducting modest efforts at pro- 
gram assessment would not be that much higher than the cost of one "grand" 
.evaluation so as \o outweigh the benefits of multtple evaluations. 

Fourth, »there needs to be careful accounting, of (he costs of the in- • 
itiatives so that effectiveness and benefits in relation to costs can be 
carefully calculated. But the "true" costs of programs are difficult to 
obtain, particularly when prograiTtnputs are under local control , since 
the parties involved may have vested interests i ( n underestimating costs 
or laying off other operational costs to the. experimental initiative. 
This problem is part of the general difficulty, discussed earlier in this 
section, of implementing social experiments where outcomes may affect the 
self-irtterests of some of the concerned parties.- 

In sum, then, there are initiatives in the Reagan scheme that, need 

to be pursued and evaluated. Their potential consequences for magnitude, 

* . 
quality, and structural arrangements of social programs require strong 

program starts and" careful assessment of prototypes before full coverage 
.programs are impl emeated.^ v ' u ' 

' • ' V ' ■ 

« 1 Q 
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APPROPRIATENESS OF PROGRAM OBJECTIVES AN0 PRIORITIES 

r • 

In' addition to the conviction that social program cutbacks are re- 
quired to reduce overall federal spending, this administration, perhaps 
even more so than those in the recent past, remains v ske*ptical about the 
utility of many established programs. However, any effort to go beyond 
skepticism to proof^of failure must confront the fact that in many cases 
there are no clear, operationa-l performance criteria on which to 'judge 
the extent of social program effectiveness. Some of the programs have 
long histories and, over time, their purposes have become blurred; others 
were implemented and their general goals were never operational ized .into 
measurable objectives.^ ^ . . 

The lack of agreed upon* measurable objectives' was recognized by 
Wholey (1979) and led to the implementation of the activity known as t 
"evaluating assessment" in DHHS and other departments. Essentially, what 

Wholey and his associates advocate is to use formal, reproducible pro- 

• * ' • a » 
cedures in a '"•pre- evaluation process," a major purposg of which is to 

explicate and codify program objectives., including both process" criteria, 

(target and delivery system operation) and outcome measures. Further, 

evaluability 'assessments lead" to identification of the various stakeholders 

involved in program) funding, implementation, and ^utcomes. In'the past. 

administration, while the potential cost-savings and efficiency benefits 

of evaluability assessments were recognized, ijhey were -supported by limited 

incentives and were only spottedly undertaken. 

• In order to rigorously examine the utility of programs, to identify / 
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* * , 

/ • * ' - ' * 

overlapping and redundant ones, and to prioritize socia'l interventions, 
I suggest that'an evalu ability assessment requirement should be attached" 
to every social program. Further, unless such an assessment is undertaken 
by a program, there should be a "sunset" provision with respect to its 
continued funding. The gains, I contend, would.be enormous. First, the i 
requirements would allow for the first time a sound appraisal of program , 
overlap and redundancy, and the opportunity to both reduce the number of 
programs and re-organize operational arrangements in a more sound basis. 
Second, it would provide a strong start for impact'and benefit to. cost 
studies of programs (which no doubt in some cases at least confirm the 
current skeptism about social programs). Third, it would x al low priority 
setting to be undertaken in terms of operational program objectives rather 
than ambiguous statements of program intent. 

Jlany programs, including some of the very politically sensitive ones, 
are characterized by the "kinds of rhetoric and ch'ffuseness tW fuel, the 
continuing debates and lead to compromise* on support and continuance, 
^education, bilingual education aod Title litre prime candidates for\^ 
evaluability assessments, as are community mental helath centers and en- 
vironmental health programs in the field of health, and various "recre- 
ational" programs and environmental control activities. 

I believe that states should be encouraged by incentives to adopt 
the evaluability assessment perspective in developing their own packages 
of services, and later I will discuss the block grant programs in more 

detail. In many, cases block grants will be funding a range of services 

i 

of which the objectives and operational criteria are even less well expli- 



cated than centrally-directed federal programs. In at least the majority 
of states, neither legislative nor operating departments have -the levels 
of expertise in policy development, planning, and program design "found 
in the federal departments. Bor a state-centered approach to social pro- 
grams to be effective and efficient in the long-term, explication of ob- 
jectives.and operational criteria is essential. • 

Indeed, in the past decade, the dissatisfaction at avstats level 
with the size-tfnd results'of human service an? regulatory activities has 
> bee'n manffest in the passing of. sunset Vegfsl&tjon (Adams' & Sherman, 1978) 
While this movement is only emerging as a potent- force in determining 
state budgetary allocations for ^social- programs, I anticipate continued 
momentum in this direction. Certainly a sunset perspective is consistent 
with the rhetoric of the Reagan administration. While I understand the 
'current wish to minimize administrative requirements in relation'tq blojk 
grant funding, I also suggest that encouragement of evaVuability assess- 
ment activities is consistent with the present federal outlook and with 
the perspective of many of our states as well. 

TESTING ALTERNATIVES TO ESTABLISHED PROGRAMS • " . 

In a previous section, I discussed social experiments in relation to 
the stated initiatives of the present administration.. It is reasonable 
to extend the Reagan perspective to include demonstrations of alternatives 
to established programs in terms of their compttitivs advantages, i.e., 
in costs to benefits .or to effectiveness.. Clearly there is a floor be- 



Tow which it is not jjssible toVeduce spending for established social*' 

programs; witness the opposition even among relatively ^conservative': 

influential to additional rounds of domestic budget cuts. 'At/ sOme point, 

alternative programs must be fared as a solution rather than reductions 

in services or redefinition^Gf eligible populations. 

The support of "demonstrations" is long established. Unfortunately, 

some have not been .undertaken in ways, that proyide estimates of costs to 

outcomes and others were simply means of 'increasing service funds without^/-- 
• ■•»•*.•• 
any serious efforts at their evaluation. Also, in a relatively large 

number of cases, there has been inadequate development and formative re- 
search prior to program initiation and testing of' impact. Programs with*-* 
minimal robustness,. target groups of sizes too small to secure significant > 
differences except under the most favorable circumstances, and studies 
too short in duration have unfortunately been characteristic of efforts 
.sponsored directly by federal Executive Departments and indirectly by- 
state and local agenctes with -federal funds. 

Thus, consistent with administration objectives, -new demonstrations 
should be initiated only if there is a reasonable, chance -they will indeed 
be cost' beneficial, and actuiajlSlmQnstrations need to be preceded by cost 
benefit or effectiveness ana ^si-si There should also be simulation of out- 
comes so" that anticipated yiel%in| terms' of changes on criteria measures 
can be documented as obtainable^given proposed target sized, duration 'of 
the intervention, and potential method effects (e.g., re^n ability of mea- . 
sures, target losses, and so on). Further, impact studies should be sup- 
ported contingent upon clear evidence, via monitoring information, that an 



interventipil is feasible and practicable) 

In particular, -the block grant programs provide an unusual Oppor- 
tunity for seeking out alternatives to established programs. States 
should be encouraged tp use a small percentage (say one percent) of' 
their Mock grants with some federal matching of~ expenditures, for such 
efforts. But in order to maximizp the return from these expenditures, ' 
there needs to be clear guidelines and surveillance of the demonstrations^ 
to avoid th> criticisms that I raised in this section abaut many previous 
demonstrations. Jhe review ^process need not be complex and unwieldy, 
but it should be of suff icien^fscope and sustained duration'to insure use- 
ful results--be they positive or negative, m 

There are numerous areas of demonstration—evaluation that are im- . 

is ■ . 

portant and consistent with the current federal posture. Use of incen- 

tr y . 

ti>ves and reorganization of work to increase "productivity in. the public 
section, including but "not confinfd to the "helping", professions, is 
called for. So too are programs, that provide incentives to increase 
..citizens' involvement in programs to combat crime, to prevent urban de- 
cay! and to improve the quality of community life. The list is long: 
We are told an oversupply of health providers is emerging and that it 
may result in increased patient* encounters so -providers can earn fees; 
that the abundance of attorneys is partly responsible for the extensive 
use of the courts for litigation; and that the ranks of many other pro- 
fessions are at surplus levels now or will be in the foreseeable future. 
Demonstrations both on new roles for surplus professionals and on ways 
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to minimize troublesome consequences of the-over- supply are required, 
then too, local government retirement policies for employess in public^ 
safety, welfare, and education have consequences for the "solvency of our 
cities and counties and for career opportunities for the younger and 
adult population; regulations on' housing density are a major -consider- 
♦ation in' the current and future ways the population is distributed, 
energy is conserved, and public services are provided; and current laws 
and regulations on credentials for deliverers of services, standards of 
product safety, and licensing of institutions impact on both governmental 
and consumer costs and access to services. _ 

I .am not advocating demonstrations that expand services, that raise 
government costs, and that further increase the role of the'federal gov- 
ernment in the .personal and community lives of our_citizen$. To the con-^ 
trary, I am arguing that , substitute and modified social programs are neces 
sary to decrease governmental costs and domination v The alternative. is 
. simply to estimate the floor and bring, social programs dO«|n io that level 
—an option 'that I contend is unwise for this administration. 

" ACCOUNTABILITY^ AND IMPACT OF BLOCK GRANTS 

I have argued earlier in this paper-that block grants provide oppor- 
tunities for program evaluation and* experimentation. k Even though one of 
the intents of block grants is to diminish federal, control , I' argue there 
is a needfor evaluation inputs in at least two areas. 

First, there is the issue of accountability.: Social program funds 



provided via block grants have- considerable flexibility-; nevertheless, 

• ■ • y 

there are-broadvareas mandated and, f*§thermore, states themselves need- 
•• '• ' ' v • . 

to explicate programs and set objectives. Accountabil ity for program 

'. f> • 

activities is" required not only because of generally accepted horm§.of 
* . ... „ . «_ - 

s public- responsibility for government funds, abut in order fo/* statesand 

the federal departments to^gauge appropriate levels of support and* pro- 
gram operations in the future: . * 

Monitoring systems that provide program managers and stakeholders 
with adequate information on operations and, if possible, on outcomes, 
has been an important area of recent development. Such systems are not 
only valuable in terms of day-to-day activities and decision making, but 
also in dealing witln broader policy matters, litigation, and' advocacy 
group pressures. We should remember that a major press for effective 
management- of social programs came early after World War II, in days of 
• more conseryative^ftscal policies than we have recently experienced (and 
sometimes in Republican^jadministrations). 1 .„ » 

The issue of whether monitoring systems should be mandated or en- 
couraged is an open one. Given the posture of the current administration 
I would opt for some set. of incentive's to encourage states to develop 
adequate systems. This may take the form bf federal-state cost sharing 
for developing and maintaining such systems; or .federal "purchase" of 
program information providing' its collection met minimum standards of re- 
liability, completeness, and accuracy; or the federal departments could 
sponsor the -development of model monitoring systems for various block 
grant areas. v »■ -. 
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• Second, a|d a related -point, ;is the tnore general issue of te^hjijcal/ 
assistance ^itates. Few state legislative committees, let alone' state . 
legislators,^ have professional 'staffs, and the Estate' equivalents of our 
federal Executive Departments,, in general , a rfr not staffed with persons 
whose professional training and expertise .are equal to those in federal \ 
departments. For example, a- private foundation provided support" for Jegis- 
.lative a^istants.in heal/h to selected state legislatures.' While they 
-were used and deemed valuable, they were not retained after the, demons tra- ' 
tion (Aiken et al . , 1980). -There were' two reasons for this: first, the » 
matter of Ending; second, the (lack of similar staff in other human ser- \ 
vice areas- created a staff "imbalance" that was deemed, inappropriate- by 
legislators. A clear findirfc was- the persistent lack of staff resources ^ 

and the need for them. ^ 

... 1 

I would like to advance two propositions. ' First, as a short-term 
•effort^ I believe federally-employed planning, program, and evaluation ^*J& 
staff persons should be made easily and. continually available to both 

* 

the executive and legislative branches of government in those states rer . 
quiring such assistance. Second, as a long-range effort, block grants 
should include incentives that increase state staff" resources, infc^d- 
.ing training programs that prepare and retread pers.ons-for evaluation o - , 

activities. Further, for at least the smaller states^ encouragement 
should be provided for developing and expanding regional organizations 
that have the necessary expertise and experience to provide; both tecli- 
nical assistance and continual- inputs into planning,' implementation, and 
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.evaluation of block-grant programs. * 4 

To some degree, of course, state-administered block grant programs 
are simpler to execute and evaluate than federally-mounted programs, 
But the matter of scale does not make the tasks that must be undertaken 
or the expertise required to carry them out substantially different. 
The evaluation of health programs that affect 3 million persons or 130 
million, or special educational programs for 130,000 or 8 million chil- 
dren are not qualitatively different activities. Some states, of course, 
are well prepared for the changed 'policy; others, either because of de- , 
pendence on federal programming or economic and political reasons, have 
not developed the needed capacities. . r 

'. Perhaps the first step is a review of existing information in this 
regard and assessment of what new data are needed. .But it seems a well- 
grounded conjecture that both accountability and innovation at a state 
level in many states require the development of organizational and human 
resources to successfully conduct the programs subsumed under block grants 
The cogency of the expansion of the block grant approach, in my opinion, 
will not be fairly tested without attention to the existence of required 
organizational structures and staff competencies. 

1 

EPILOGUE 

The agenda, however incomplete, that I have set forth requires both 
a commitment and a fiscal investment of some scale on the part of the ^ 
Reagan administration. But in relative terms, when compared with federal 
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social program expenditures even at the current and projected reduced 
scales, the investment is quite small. Certainly no business or indus- 
trial <. corporation, particularly in- a period of marked reorganization, 
would neglect its R and D and accountability responsibilities. I am 
neither arguing for nor supporting evaluation activities as they were 
directed in the past; nor did I write this paper simply to promote the 
evaluation enterprise. Rather, my position is that a strong start and 
long-term success of the administration's program depends on developing 
an appropriate evaluation agenda; perhaps the views provided here will 
stimulate such an effort, and soon. 
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